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Fig. 1: During a speecii auditors perceive interesting topics 



BEST AVAILABLE COPY 



10/528175 



WO 2004/029831 PCT/EP2003/009310 

2/20 




Fig. 2: During a radio or television program an auditor 
perceives interesting topics 
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Hyperiinked term y 


URL / 


■Phenofar / 


http:/Amw.8ton8hIQwIneiy.com/heatth.Mml / 


*R6SV8l8trel* * 


http:/,^MW^.utuceiluMm/ro3V8ZB.htmI ' 


■ThnnlnS" 
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"EnaglcaCid' 


httpUSAMMW.hoperofcanc8r.co1n/i9lla9lcacM.htm 


"HydraxydnnamatBaT 


http:/AmMf.swot9.nt/^ps/]oumals/pb36000s.html 


•Ravoiv3-oI9" 


httpJAMMtf.nyas.org/taitsch/tom/conrj>1j0426.html 
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Fig. 3: The speaker workstation and auditors devices are 
synchronized. Hyperiinked terms pronounced by the 
speaker are automaticaily recognized during the speech 
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The concentration and molecular structure of the phenols changes as 
grapes are processed into wine, and as new wine ages into old wine. 
Oxidation (the addition of an oxygen atom to a molecule) takes place, 
and the resulting molecules further. Interact with each other. 
Resveratrol loses glucose of its molecule. The. oak barrel tannins 
break down and release ellagic acid. After a few months, the 
hydroxyclnnamates begin to break down. The "flavon-3-ols from 
bonds with other molecules and change into a form that is not found 
In the firesh grape. 

The good news about ail these chemical changes is that as wine ages, 
the number of anti-oxidizing molecules in it actually increases. 
Anti-oxidants purge the body of free radicals and are good for us. 

The bad news is that, despite the increase in the number of 
anti-oxidizing molecules overtime, their bioavailability decreases. 
The anti-oxidizing molecules that are formed during aging are much 
larger than the original phenols, and thus are not well absorbed in the 
alimentary canal. After one or two years of aging, the amount of 
anthocyanin has decreased to about one-sixth of the original level. 
After five to ten years, wine has lost most of the smaller, and 
presumably health friendly, phenols. "When we look at very old wine, 
the only compon^ that stands out Is gallic acid". 

So, ironically, a $7 bottle of 3-year old wine is a healthier drink than a 
$600 bottle of 25-year old wine. (Of course, it may not taste as goodi). 
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Fig. 4: The speaker prepares the speech text 
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The concenbation and n^frics'cuTariMi^i^^^o^ the 'phenols changes as 
grapes are process]^ 1nto.:v^ rii^ win^ ages into old wine. 

Oxidation (the.addition..of an o^^en jlitom tp a motepule) taices place, 
and the resulting molecules fuirther ihjteract Vviith each other. 
Resveiratrol loses^iucose of it^ molecule. The pak barrel tannins 
break down and release ellalqic acid , ^er a fewmonths, the 
hvdroxvcinnamates begin to break d<^^. The fflavon-3-ols from 
bonds witii other molecMles and chai](sj[e into a forniltiat Is not found 
in the firesh grape. \\ 

/ I \ 

The good news abqut all these chemi^l changes is that as wine ages, 

the number of anti^bxidizing molecule^ In it actually increases. 

Anti-oxidants purge the body of free radicals and are good for us. 

The bad nevt^/ls that, despite the incr4a4e in the number of 
ant{-oxidizln0 molecules overtime, thelir bioavailability decreases. 
The anti-oi^izing molecules that are fori^d during aging are much 
larger thart the original phenols, and ttiu4 are not well absorbed in the 
allments^iV canal. After one or two years ^f aging, the; amount of 
anthocvanin has decreased to about one^slxth of the original level. 
After five to ten years, wine has lost most bf the smaller, and 
pre^mably health friendly, phenols. "Wh4n we look at very old wine, 
th^lonly component that stands out is gallic acid" . 

So, ironically, a $7 bottle of 3-year old win4 is a healthier drink than a 
$600 botUe of 25-year old wine. (Of course^ it may not taste as goodl). 
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Fig. 5: The speaker selects hyperlinked terms in tlie text 
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Speech Hyperlink Table (soo) 



Hyperlinked 
term 


URL / 


"Phenols" 


http://VvMAv.stonehillwinery.com/health.htnil 


"Resveratrol" 


http:/Awww.ag^luc.edu/--ffh/resvera.htrnl 


"Tannins" / 


http://www.mangiarebene.net/Wine/nianual/health.html 


"Ellagicacid" 


http://Www.tiopeforcancer.com/ellagicacid.htm 


"Hydroxyjiinnamates" 


http://Wwv/:8wets.nl/sps/joumals/pb36000s.html 


"Flavon/3-ols" 


http://Wvyw.nyas.org/scitech/sum/conf_01_0426.html 


"Free i^adlcals" 


http://vyWw.who.sci.eg/publications/emhj/0402/2 1 .htm 


"Antfcibcyanin" 


http:/|www.orst.edu/dept/lpi/ss01/anthocyanin.html 


"GaUlicadd" 


http^yWww.vlnsetsante.conn^5e.html 



(602) 



Fig. 6: The speaker creates a Speech Hyperlink Tabie and 
associates an address with each hyperlinked term 
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Vocabulary of 
hyperlinked terms 



"Phenols" 



'Resveratror 



"Tannins'" 



"Ellagicacid" 



"Hydroxycinnamates" 



"Flavon-3-ols" 



"Free radicals" 



"Anthocyanin" 



"Gallic acid" 
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Fig. 7: Ttie speaker trains the Speech Recognition 
System to recognize hyperlinked terms 
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Vocabulary of 
hyperlinked terms 



•Phenols" 



'Resveratrol' 



•Tannins" 



"Eilagicacid" 



•'Hydroxycinnamates^' 



••Flavon-3-ols'^ 



(803) 



"Free radicals" 



Speaker 



•'Anthocyanin" 



"Gallic acid" 




Speech Recognition System 
(801) 




Fig. 8: During the speech, the Speech Recognition System 
recognizes hyperiinked terms pronounced by the speaker 
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Speech 
Hyperlink-Time Table 
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. : 1 ^ ^ 

(^12^05/2001 14:23:18 "Resveratrol" imp:/Mwwwiiuc^duMfh/lBsvefa.htini ^ 



Universal time of 
hyperlinked term 
recognition 
(904) 

( 12^05/2001 \4:23:18 f 

\ 



Speaker 
(900) 




Speech Recognition System 
(901) 



Fig. 9: Hyperlinked terms and associated addresses and universal 
times are recorded on a Speech Hyperlink-Time Table on a 
Speech Server 
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(1001) 



Speech Hyperlink-Time Table 



(1002) 



SP.6ECH.TITLE: 

' Wine & Heallh> 


SPEAKER: 

Louis Durand 


SPEgCH HYPRRUINK-TIIVIETARI FliEWL/ 
nmp^/Vinww.directbuyer.com/conference-OI TSHitn^ 


RECOGNITION 
TIME 


HYPERLINKED 
TERM 


HYPERLINK URL 


12/05/2001 14:22:52 


Phenols. 


http://Www.stonehillwinery.com/health.html 


12/05/2001 14:23:12 


Resveratrol 


http://www.ag.uiuc.ed Lt/'^ffh/resvera.html 


12/0^/2001 14:23:25 


Tann^s 


http://Www.mangiarebene.net/wine/mahual/health.htm 

1 \ 


12/05/^001 14:23:39 


Ellagid.acid 


http://www.hopeforcancer.com/ellagicac^d.htm 


12/05/^001 14.23:57 


Hydro}^cinnamates 


http://www.swets.nl/sps/Joumals/pb3600Qs.html 


12/05/2001 14:24:11 


Flavon-d-ols 


http://www.nyas.ora/scltech/sum/conf_01i0426.html 


12/05/2001 14:24:35 


Free radicals 


http://Www.who.sci.eg/pubiications/emhj/0402/21.htm 


12/05/20^1 14:24:49 


Anthocyabln 


http://www.orst.edu/dept/lpi/ss01/antho(^ahin.html 


12/05/200^ 14:25:08 


Gallic acid. 


http://Www.vinsetsante.com/za5e.html 




\ 


t 


\ 


\ 

\ 


\ 

^ i 


\ 








\ 


\ 


/ \ 


\ 
\ 





(1000) (1003) 



(1004) 



(1005) 



Fig. 10: Example of Speech Hyperlink-Time Table stored on the 
Speech Server 
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Fig. 11: During the speech, the auditor selects interesting 
hyperiiniced terms by pressing a reserved Icey on the auditor device 
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1 



Selections Hyperlink-Time Table 



(1201) 



SPEECH TITLE: 
Wifie.& Health-... 



SPEAKER: 
Louis Durand 



SPEECH HYPERUNK-TIMETABbEliRL: / 

'Kttp7Aivv)w.directbuyer.com/conferenc^ 



.^ELECTION TIME 



HYPERLINK 



HYPERUNK URL 



12/05^001 1423:14 



12/05/2001 1423:42 



12/05/2001 1424:52 



-7^ 

(1200) 



Fig. 12: Universal times corresponding to tiie selection of 
terms by the auditor are stored in a Selections 
Hyperlink-Time Table on the auditor device 
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Hyperlink-Time Table 




Fig. 13: The auditor updates the Selections Hyperlink-Time 
Table from the Speech Hyperlink-Time Table stored on the 
Speech Server 
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SPEECH TITLE: 
Wine & Health 


SPEAKER: 
Louis Durand 


SPEECH HYPERUNK-TIMETABLE URL: 

http7ANww.drectbuyer.com/conference-0173.htm/ 


SEtECf iON tlME... 


HYPERUNK 


HYPERLINK URL 


12/05/2001 14:23:14 






12/05/2001 14:23:42 


■J— 




•12/05/2001 14:24:5?. 







SPEECH TITLE: 
Wine & Health 


SPEAKER: 
Louis Durand 


SPEECH HYPERLINK-TliVIETABLE URL' 

htlp://www.directbuyer.com/conference-0173.htm/ 


RECOGNITION 
TIME 


HYPERLINKED 
TERiVI 


HYPERLINK URL 


12/05/2001 U:22:S2. 


Phenols 


http:/AftWw.stonehiI!vvinery.corn/health.html 


12/05^01 14:23:12 


Resveratrol 


http:/AAAAw.ag.iJuaedu/Hfh/ire8verahtmt 


12/05/2001 14:23:25 


Tannins 


http://Vwvw.manglarebene.netAAflne/manua^ 


12/05/2001 14:23:39 


Eilagic add 


http:/AA^^w.hopefo^c^nce^com/ell^cactd.lTtm 


12/05/2001 14:23:57 


Hydroxyclnnamates 


http:/AMAw.swets.nl/8p64oumal8/pb360008.ht^ 


12/05/2001 14:24:11 


Flavon-3-ois 


http:/AMMV.nyas.org/scitech/sum/conf_01_042ahtml 


12/05/2001 14:24:35 


Free radicals 


http:/AMAW.vvho.sci.eg/pub!icatioiWemhj/0402/21.htm 


12/05/2001 14:24:49 


Anthocyanin 


http://Vvww.orstedu/dept/lpi/ss01/anthocyanin.html 


12/0S/2G01 14:25:08 


Gallic add 


http:/AMAW.vlnsetsante.comto5e.html 












1 




(1401) 


SPEECH TITLE: 
Wine & Health 


SPEAKER: 

Louis Durand 


SPEECH HYPERLINK-TIMETABLE URL: 

http:/Awww.directbuyer.com/conference-0173.htm/ 


SELECTION TIIViE 


HYPERLINK 


HYPERLINK URL 


12/0^2001 14:23:14 


Resveratrol 


http:/AAAwv.ag.uluc.edu/-ffh/resvera,html 


12/05/2001 14:23:42 


Eliagic add 


http://Vvww.hopeforcancerxom/elIagicacldh4m 


12/05/2001 14:24:52 


Anthocyanin 





(1402) 



Fjg. 14: Hyperlinked terms selected by the auditor are identified 
and copied from the Speech Hyperlink-Time Table into the 
Selections Hyperlink-Time Table 
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Speech Server 
(1507) 



"Ellagic acid 

hyperlink at: (1504) 

^http://www.hopeforcancer.com/ellagicacid.htrtr ) 

Selections 



IHyperlink-Time 
Table 
(1502) 

Auditor device 
(1500) 




Fig. 15: Hyperlinks are triggered using the Selections 
Hyperlink-Time Table 
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www. hopeforca ncer.com 

Web Servers 



Speech Server 



Retrieved Web 




Received 
Web page 
(1604) 



Fig. 16: The Web page related to the selected term is recehfed 
from the Web server and displayed on the auditor device 
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Editing the text or a draft text of the speech 

T 



1701 



^ Selecting on the speech text a plurality of wordar' ^ 
or terms for which hyperlinks must be created 

\ 



1702 



breating a Speech Hyperlink Table for the speech^ ^ 



1703 



on the speaker workstation 



I 



Assigning a name or a description (preferably 
a brief description) to hyperllnked terms 



I 



Assigning a destination address (URL) 
to access multimedia information 

* 



1704 



1705 



Storing in the Speech IHyperlink Table the assigned: ^ 
' hyperlink name (or description), and 
- the destination address 



1706 



I 



Training with the hyperllnked terms 

a Speech Recognition System 
running on the speaker workstation 



1707 



Fig. 17: IMethod for creating a Speech Hyperlink Table for a 
speech and for training a Speech Recognition System with 
hyperllnked terms 
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Creating a Speech Hyperlink-Time Table 
for the speech on a Speech Server 



1801 



. i v^1802 

Recognizing the pronunciation of hyperlinlcecl ^ 



terms by means of a 
Speech Recognition System 



1803 



Determining the universal-time 
corresponding to the recognition of the term 



I 



Creating a record including 
- the universal time; 
- the name of hyperlinlced term; 
the address associated with hyperiinked term 



1804 



I 



Storing the record on a Speech Hyperlink-Time 
Table on the Speech Server 



1805 



Fig. 18: Method for creating a Speech Hyperlink-Time Table 
on a Speech Server and for recognizing the pronunciation 
of hyperiinked terms during a speech 
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Creating a Selections Hyperlinlc-Time Table 
for the speech on the auditor device 

i 



1901 



Recording on the Selections HyperUnk-Time ^ 
Table the address of the Speech Hyperiink-Ume 
Table on a Speech Server 



1902 



} 



Listening to the speech given by the 
speaker 



1903 



I 



Perceiving a topic of interest for which 
additional information or service is desired 



1904 



C 



I 



Selecting a topic by entering a selection 
command on the auditor device 



1905 



i 



Determining the current universal time by means of 
an universal time device (for instance a GPS receiver) 
integrated or connected to the auditor device 



^^1906 



C 



I 



Recording the universal time In the Selections 
Hyperlink-Time Table 



T 



1907 



Fig. 19: Method for creating a Selections Hyperlinlc-Time 
Table and for selecting topics of interest in a speech 
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Recessing the Speech Server from the auditor devicej 



2001 



Sending to the Speech Server 
the recorded universal time 



2002 



^ _ 2003 

Searching in the Speech I4yperlink-Time Tabley 



on the Speech Server for the hyperlinked 
term active at said recorded universal time 



T 



Retrieving from the Speech Hyperlink-Time 
Table in the Speech Server the name and the 
address of the selected hyperlinked term 



2004 



T 



Storing the retrieved hyperlink name and 
destination address (URL) into the corresponding 
entry of the Selections Hyperlink-Time Table 

' I 



^--2005 



Selecting a hyperlink from the Selections 
Hyperllnk-Tlme Table 



i 



Activating the hyperlink using a browser ^ 
program in the auditor device 

i 



2006 



2007 



Accessing the information and/or service ^ 



2008 



1 



Retrieving and displaying the information >p'2009 
and/or service using the browser program 
on the auditor device 



Fig. 20 : Method for accessing information related 
to selected terms 
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